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(2) A data processor for performing simultaneous instruction retirement and backtracking. 
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© A data processing system (10) which has 
more general purpose physical registers than 
architectural (logical) registers. The system (10) 
uses a register inventory system (90) to monitor 
the allocation state changes of physical regis- 
ters in a register file (37). As a sequencer (20) 
issues instructions, an indexed random access 
memory (RAM) (92) stores a copy of visible and 
allocation state bits for each of physical regis- 
ters. When the sequencer (20) needs to perform 
a branch repair, the sequencer (20) must back 
up to the checkpoint where the branch instruc- 
tion was issued. The visible and allocation bits 
for each physical register at this checkpoint are 
read out of the RAM (92). Using a predefined 
back-up deallocation relation, the register in- 
ventory system (90) determines which physical 
registers to deallocate and returns those physi- 
cal registers to a free pool. The register inven- 
tory system (90) allows the sequencer (20) to 
simultaneously retire any instructions which 
were completed, and discard any instructions 
marked by the back-up process. 
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FIELD OF THE INVENTION 

This invention relates generally to data proces- 
sors, and more particularly to pip lin d data proces- 
sors capabl of simultan ously xecuting a variable 
number of instructions. 

BACKGROUND OF THE INVENTION 

Historically, implementations of data processors 
were restricted to "in-order" instruction execution. 
Generally, the restrictions imposed by an "in-order" 
execution scheme limit the performance attainable 
using the data processor. In contrast, allowing the use 
of "out-of-order" instruction execution may increase 
data processor performance by a factor of three (3) or 
more. Attaining this performance increase is ham- 
pered, however, by the requirement of maintaining 
precise exceptions. Exception conditions are detect- 
able during the execution of an instruction, such as an 
attempt to divide by zero. In a processor implementing 
precise exceptions, the effects of the excepting in- 
struction are undone and a trap is taken, such that it 
appears to the program that the instruction never be- 
gan. Typically, known data processors which maintain 
precise exceptions are either expensive or restrictive 
with respect to the number of instructions executable 
per clock cycle. 

In an "out-of-order" data processor, only the in- 
struction execution occurs out of program order (se- 
quence). Thus, instructions are still "issued" in pro- 
gram order, and "retirement" (the act of completing an 
instruction and allowing its side effects to become visi- 
ble) also occurs in program order. A data dependency 
is said to exist between two instructions when the first 
instruction produces a result consumed by the second 
instruction. Fundamentally, only the data dependen- 
cies between instructions limit the order of instruction 
execution. Naturally, there are several factors which 
may limit the performance of an "out-of-order" data 
processor. The primary factor is the rate at which in- 
structions are issued by the processor. A "conserva- 
tion of instructions" property states that the average 
rate of instructions executed per clock is limited by the 
average rate of instruction issued per clock. 

A secondary factor which may limit the perfor- 
mance of an "out-of-order" data processor is the rate 
of "retirement" of instructions. Initially, the processor 
is not executing any instructions. The processor be- 
gins fetching and issuing instructions. As previously 
indicated, issuance and "retirement" must occur in 
program order. Accordingly, until the execution of the 
first instruction issued by the processor is completed 
and retired, no subsequently issued instruction may 
be retired. While th processor waits to retir the first 
instruction, it continues to issu instructions. Thus, 
the processor may complete th execution of a num- 
ber of subs quently issued instructions; how v r, th 



"retirement" of these subsequently issu d instructions 
is deferr d until th first instruction is completed and 
retired. Assuming the processor issues instructions at 
a constant rat , th net number of instructions in the 

5 processor is a monotonically incr asing function. 

A final factor which may limit the performance of 
an "out-of-order" processor is the branch prediction 
recovery time. When an instruction issuer encounters 
a conditional branch instruction, it has at least two 

10 possible courses of action. First, the instruction issuer 
can stall the issuance of the instruction. This action is 
undesirable in light of the primary factor affecting the 
processor's performance (rate of instruction issu- 
ance). Second, the instruction issuer can predict the 

15 direction of the branch and continue issuance of in- 
structions down the predicted path. If the predicted 
path is incorrect, however, the registers) affected by 
the incorrectly issued instructions must be restored to 
their original value. Thus, using the second approach 

20 maintains a high effective issue rate only if (1) the pre- 
diction is right most of the time, and (2) when the pre- 
diction is wrong, it doesn't take too long to start issuing 
the correct instructions. There are a significant num- 
ber of algorithms capable of correctly predicting 

25 branches most of the time; however, once an algo- 
rithm is selected, the system designer has little control 
over what actually happens in the system at run time. 
When the prediction is incorrect, it is necessary to 
minimize the branch repair time, since as long as the 

30 branch repair is occurring, the processor cannot issue 
instructions. Consequently, the frequency of the stalls 
attributable to branch repair will adversely affect over- 
all machine performance. 

Implementing a register file in an out-of-order ma- 

35 chine presents additional problems. The retirement 
restriction dictates that no side effects appear out of 
program order. Known processors employ reorder 
buffers to overcome the problem of having register 
side effects occur in program order. Initially, an issu- 

40 ing instruction reads its operand from one of a fixed 
number of addressable registers (e.g. general pur- 
pose registers) in a register file. Next, the instruction 
is issued and the associated operations are per- 
formed. If the instruction has a register destination, 

45 the specified register in the register file is not modi- 
fied. Instead, a slot in the reorder buffer is allocated 
for the result. When the instruction completes execu- 
tion, the reorder buffer is modified instead of the spe- 
cified register in the register file. As new instruction is- 

50 sue, they read modified registers from the reorder buf- 
fer; however, unmodified registers are still read from 
the register file. Thus, the process of retirement en- 
tails taking the modified registers from the reorder buf- 
fer and writing them back to the register file. The rate 

55 of retirem nt is limited by the rate at which th proc- 
essor can read the reorder buffer (th numb r of read 
ports on the reord r buffer), and write th r gister file. 
Thus, by using a reorder buffer, the system design r 
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may achieve zero time branch repair (by throwing 
away th section of the reorder buffer that is no longer 
valid); howev r ( the retirement rat is limited. 

One solution employed to cure the ills of th re- 
order buffer's limited retirement rat isth implem n- 5 
tation of a "history buffer" (history buffer). As instruc- 
tions are issued, the registers requiring modification 
are copied into the history buffer before they are modi- 
fied. Accordingly, the values in the history buffer rep- 
resent "old" register values. As instructions complete 10 
execution, their results are stored directly into the reg- 
isterfile. Thus, the process of retirement entails decid- 
ing when an instruction is complete. Typically, the 
processor "decides" the results of any number of in- 
structions during a clock period, therefore, the rate of 15 
retirement is unlimited. Slots in the history buffer stor- 
ing old values for "decoded" instructions are simply 
discarded. In contrast, when a branch repair is neces- 
sary, the rate at which the system restores the old reg- 
ister values will limit the branch repair time. Thus, us- 20 
ing a history buffer, the system designer may achieve 
a retirement time of zero; however, the branch repair 
rate is limited. 

Accordingly, both the reorder buffer and the his- 
tory buffer perform well in accomplishing one objec- 25 
tive, but fail to perform well in accomplishing the other. 
Essentially, the problem is that both approaches (re- 
order buffer and history buffer) require the physical 
movement of data. The reorder buffer moves data in 
the act of retirement. Whereas, the history buffer 30 
moves data in the act of branch repair. Thus, it is de- 
sirable to provide a mechanism which accomplishes 
the foregoing objectives without physically moving 
data. 

35 

SUMMARY OF THE INVENTION 

A data processing system is provided which has 
a predetermined number of execution units for simul- 
taneously executing a plurality of instructions issued 40 
by a sequencer, and a plurality of numbered physical 
registers in a register file for selectively storing infor- 
mation resulting from execution by said execution 
units of each of the predetermined number of instruc- 
tions. The data processing system includes a system 45 
for performing instruction retirement comprising re- 
tirement logic for monitoring an allocation state 
change of each of the physical registers, in response 
to the sequencer advancing from a first consistent 
checkpoint to a subsequent retirement checkpoint. so 

BRIEF DESCRIPTION OF THE DRAWINGS 



FIG. 1 is a block diagram illustrating a preferred 
embodiment of a data processing system of th pr s- 
ent invention. 

FIG. 2 is a block diagram illustrating a logical reg- 
ister content addressabl memory (LRCAM), of the 
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data processing system of FIG. 1, in accordance with 
the present invention. 

FIG. 3 is a register state diagram for th physical 
registers of the data processing system of FIG. 1, in 
accordance with th pres nt invention. 

FIG. 4 is a diagram illustrating the progression of 
instruction issuance in the data processing system of 
FIG. 1. 

FIG. 5 is a diagram illustrating an instruction re- 
tirement scenario, in accordance with the present in- 
vention. 

FIG. 6 is a diagram illustrating an alternate meth- 
od for defining a retirement deallocation scheme. 

FIG. 7 is partial schematic diagram illustrating a 
single register inventory system of the LRCAM of FIG. 

2. 

DETAILED DESCRIPTION OF A PREFERRED 
EMBODIMENT 

The terms "assert", "assertion", . "negate" and 
"negation" will be used to avoid confusion when deal- 
ing with a mixture of "active high" and "active low" sig- 
nals. "Assert" and "assertion" are used to indicate that 
a signal is rendered active, or logically true. "Negate" 
and "negation" are used to indicate that a signal is ren- 
dered inactive, or logically false. 

The present invention may be implemented in a 
variety of computer system environments. According- 
ly, the data processing system 1 0 of FIG. 1 is provided 
for illustrative purposes only, and is not intended to 
limit the scope of the invention. Shown in FIG. 1 is a 
block diagram of a data processing system 10 in ac- 
cordance with a preferred embodiment of the present 
invention. In operation, an instruction buffer 12 fetch- 
es a number of memory locations from an external 
memory (not shown) via a bus interface unit 14. A de- 
coder 16 re-organizes the information stored at the 
memory locations into a "packet", where each packet 
consists of one to six instructions. A decoded instruc- 
tion cache (DIC) 18 receives the decoded packets 
from the decoder 16 and stores the packets (prede- 
coded groups of instructions) pending their selection 
by a sequencer and window control logic unit (SE- 
QUENCER) 20. The DIC 18 functions as a source of 
packets for an instruction bus 44. Alternatively, the 
decoder 16 may directly provide an instruction packet 
to the instruction bus 44. 

In the preferred embodiment, DIC 18 functions in 
a similar manner as a conventional instruction cache 
with the exception that the instructions are predecod- 
ed. Instruction issuance occurs when the SEQUENC- 
ER 20 selects a packet for execution, and the DIC 1 8 
provides the decoded instructions in the selected 
packet to one or more sets of stations in a group of 
reservation stations 31-36. In the preferred embodi- 
ment, when the data operands for an issued instruc- 
tion ar not availabl , the instruction is stored in a res- 
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ervation station pending the availability of the required 
data. Once th requisit data op rands are available, 
the instruction is transferred from a reservation station 
(in one of the group of reservation stations 31-36) to 
a function unit 25-30, respectively, for xecution. A 5 
conditional cache 24 provides a storage area for (i) 
partially completed memory instructions, (ii) complet- 
ed but not retireable memory instruction, and (iii) com- 
pleted and retired memory operation data, thereby in- 
suring that memory operations are executed in the 10 
correct order. 

In accordance with the preferred embodiment, 
function units 25-30 are coupled to a distribution bus 
45 which comprises six (6) independent buses each 
with their own conventional bus driver logic (not 15 
shown). Upon completing execution of an instruction 
packet, the respective function unit 25-30 drives the 
information out onto the independent bus dedicated to 
the respective function unit. Accordingly, only the out- 
puts of the function units 25-30 drive the six (6) inde- 20 
pendent buses of the distribution bus 45. The SE- 
QUENCER 20 monitors the distribution bus 45 to de- 
termine whether an instruction packet has successful- 
ly executed. In the preferred embodiment, the SE- 
QUENCER 20 does not read the data placed on the 25 
distribution bus; however, SEQUENCER 20 does de- 
tect which instructions have distributed information, 
and thereby ascertains the completion of an instruc- 
tion packet. The SEQUENCER 20 functions to limit 
the number of active instruction packets (where active 30 
means issued but not yet retired) present in the data 
processing system 1 0 at any given time. If the number 
of instruction packets currently present in the system 
10 does not exceed a predefined limit, the SE- 
QUENCER 20 will continue to issue instructions from 35 
either the instruction buffer 12 or the DIC 18. 

The architectural (logical) registers are those 
which a program manipulates during instruction exe- 
cution. In registers files 37-39 there are more physical 
registers than logical (architectural) registers. In ac- 40 
cordance with the present invention, register files 37- 
39 are logically equivalent to each other, therefore, 
each register file 37-39 contains at all times identical 
information. At system reset, each logical register of 
the instruction set architecture being emulated by the 45 
data processing system 1 0 is assigned a physical reg- 
ister, in register files 37-39, to represent it Physical 
registers assigned to a logical register are referred to 
as "visible". Since there are more physical registers in 
register files 37-39 than there are logical (architectu- so 
ral) registers, the balance of the physical registers are 
not assigned to a logical register at reset. Thus, the 
physical registers in register files 37-39 which are not 
assigned at reset form a "free" pool. The physical reg- 
isters in the fr e pool are referred to as "invisible". At 55 
any one time, ther exists exactly one physical regis- 
ter representing ach logical regist r. Accordingly, for 
each instruction, source logical registers to b read 



are first translated from a logical to a physical register. 
All currently visible physical registers are s arched as 
part of this process. 

During the instruction issuance process, physical 
registers assigned to logical registers are read from 
the register files 37-39. In the present invention, the 
translation (selection of the physical register) is per- 
formed using Logical Register Content- Addressable 
Memories (LR CAMs) 40-42, which are comprised of 
a predetermined number of CAM cells 50 (FIG. 2). As 
shown in FIG. 2, each physical register 48 in register 
files 37-39 has a LR CAM cell 50 associated with it. 
Stored in a word latch 60 of each LR CAM cell 50 is 
a number identifying which logical register is currently 
assigned to the associated physical register 48. Sim- 
ilarly, stored in a latch 76 is a visibility (V,) flag bit in- 
dicating whether the physical register 48 is currently 
visible. In translating a logical register to a physical 
register 48, the logical register number is simultane- 
ously applied to each cell 50 in the LR CAMs 40-42. 
Each cell 50 compares the logical register number to 
be translated to the number stored in word latch 60. 
If the two logical register numbers match, and the V 
flag bit identifies the associated physical register 48 
as being visible, then the physical register 48 associ- 
ated with the matching LR CAM cell 50 is used as a 
source for the logical register being translated (i.e. 
read). 

As previously indicated, at reset each logical reg- 
ister is allocated to a physical register to represent it. 
During allocation, which occurs after the physical reg- 
isters have been read, the V flag bit stored in the vis- 
ibility latch 76 is set by an ALLOCATE control signal. 
In a preferred embodiment of the present invention, 
the translation from logical to physical register is per- 
formed accordingly. During translation, the READ 
CONTROL signal is asserted, and the MAP CON- 
TROL signal is negated. A comparator 62 compares 
the source logical register number to the number stor- 
ed in the word latch 60 and provides the logical result 
of the comparison to AND gate 70. When a compari- 
son match occurs, AND gate 70 receives a logic high 
output signal from the comparator 62, and a logic high 
signal from visibility latch 76, and provides a logic high 
SELECT signal to AND gates 68 and 74, in response 
thereto. In response to the logic high SELECT signal, 
and the logic high READ CONTROL signal, AND gate 
74 asserts a READ ENABLE signal, thereby enabling 
the contents of physical register 48 to be read. Since 
the MAP CONTROL signal is negated, AND gate 68 
does not reset the V flag bit stored in the visibility latch 
76. Thus, the SELECT signal is used to read the phys- 
ical register 48. This direct selection of the physical 
register 48 reduces the access latency to the data. 

In accordance with the present invention, register 
mapping and remapping also make use of the LR 
CAMs 40-42. Inst ad of using th SELECT signal to 
read a physical r gister, the SELECT signal is used 
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to reset the V| flag bit of a matching physical register. 
After the source logical registers are translat d, the 
destination logical r gist rs to be written ar assigned 
("mapped") to physical registers allocated from th 
fr e pool. During register mapping, an allocator (not 5 
shown) uses a register allocation algorithm to select 
a set of physical registers to be allocated, and asserts 
an ALLOCATE signal. The assertion of the ALLO- 
CATE signal in turn causes the assertion of a WRITE 
ENABLE signal, which enables the logical register 10 
number and instruction number to be stored in latches 
60 and 64, respectively. Thus, a new physical register 
is assigned to store the value of each destination log- 
ical register produced by an instruction using that des- 
tination logical register. The LR CAM cell 50 for the 15 
newly assigned physical register is modified to repre- 
sent a destination logical register by storing the des- 
tination logical register number in the word latch 60 of 
the LR CAM cell 50, and modifying the V, bitflag in the 
visibility latch 76 to indicate that the physical register 20 
is now visible. 

Physical registers previously assigned ("allocat- 
ed N ) to the destination logical registers must be un- 
mapped, and made "invisible". During unmapping, the 
MAP CONTROL signal is asserted. The destination 25 
logical register number is applied to all LR CAM cells 
50. Comparator 62 compares the destination logical 
register number to the logical register number stored 
in latch 60, and the result is provided to AND gate 70. 
When a match occurs, and the V,-flag bit in latch 76 30 
is set, AND gate 70 provides a logic high SELECT sig- 
nal to AND gate 68. AND gate 68 receives the SE- 
LECT signal and the MAP control signal, and resets 
the V r flag bit in latch 76, in response thereto. During 
unmapping, the READ CONTROL signal is negated, 35 
therefore, AND gate 74 does not assert the READ en- 
able signal. Essentially, for any LR CAM cell 50 whose 
V| bitflag indicates visibility, and whose word matches 
the destination logical register number, the V| bit flag 
is modified (reset) to indicate that the physical register 40 
is no longer visible. In the preferred embodiment, data 
processing system 1 0 determines which physical reg- 
ister is allocated before the actual mapping of the that 
physical register. Thus, the use of the LR CAMs 40- 
42 eliminates the need for the mapping tables used in 45 
the prior art, which involve one level of indirection to 
implement the register renaming. 

In accordance with the present invention, the 
process of sourcing logical registers using the register 
files 37-39, and assigning logical registers to new 50 
physical registers in the register files 37-39 is referred 
to as instruction "issuance". Retirement of an "issued" 
instruction "A" is allowed to occur when data process- 
ing system 10 completes the execution of instruction 
"A", and the xecution of all instructions issued prior 55 
to instruction "A" is also complet . FIG. 3 illustrates a 
register state diagram 80 for the issuanc , backtrack, 
and retirement process s. SEQUENCER 20 issues 



an instruction and the operands for that instruction are 
read from source logical registers, which ar translat- 
d into physical registers in register fil s 37-39. Upon 
completion of the instructions, th results are written 
back to destination physical registers assign d to 
physical registers taken from the free pool. As previ- 
ously indicated, source logical registers are assigned 
(mapped) to physical registers taken from the free 
pool during instruction issuance. 

After the source logical registers are mapped, the 
destination logical registers to be written are assigned 
to physical registers allocated from the "free" pool, 
and these physical registers become "allocated visi- 
ble" registers. During this allocation process, any 
physical registers previously assigned to these des- 
tination logical registers are unmapped, and the un- 
mapped physical registers become "allocated invisi- 
ble" registers. Upon instruction completion ("retire- 
ment") the allocated invisible registers are returned to 
the free pool, and the process continues. The process 
of returning previously assigned physical registers to 
the free pool is referred to as "deallocation". 

As the SEQUENCER 20 issues instructions it 
sets a flag bit in a conventional scoreboard. During 
the instruction execution process, the instructions are 
tagged, and indexed to indicate when an instruction is 
complete (DONE), or when an error occurred during 
execution of the instruction. Upon completing the exe- 
cution of a given instruction, the function units 25-30 
distributes the information onto the distribution bus 
45, which is monitored by the SEQUENCER 20. The 
function units 25-30 also assert an INSTRUCTION 
DONE CONTROL signal for the given instruction, and 
transfer the TAG number corresponding to the com- 
pleted instruction, along with the destination logical 
register number to the LR CAMs 40-42, via the distrib- 
ution bus 45. A comparator 66 in the LR CAMs 40-42 
compares the TAG number to an instruction number 
stored in latch 64, and provides the result of the com- 
parison to AND-gate 72. When a match occurs, AND- 
gate 72 asserts a WRITE ENABLE signal, thereby al- 
lowing the function unit 25-30 to directly write the re- 
suit of the executed instruction to the physical register 
48 in register files 37-39. 

In the preferred embodiment, data processing 
system 10 employs a branch prediction algorithm to 
predict the outcome of the execution of a branch in- 
struction (hereinafter referred to as "branch predic- 
tion"), prior to the execution of that branch instruction. 
Consequently, it is possible that the SEQUENCER 20 
may incorrectly issue a stream of instructions based 
upon a faulty branch prediction. When a faulty branch 
prediction occurs, correct emulation of the instruction 
set architecture requires that the data processing sys- 
tem 1 0 undo any state changes that result from th in- 
correctly issued instructions (h r inaft r ref rred to 
as "backtracking"). If during the process of incorrectly 
issuing these instructions physical registers w r un- 
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mapped (unassigned), and if these physical r gisters 
were also deallocated, th system 10 would not b 
able to perform the backtracking operation. It is, th re- 
fore, imperativ that th unmapped physical registers 
are deallocated only when th instructions actually re- 5 
tire. Deallocation after retirement enables the data 
processing system 10 to perform the backtracking op- 
eration when a faulty branch prediction occurs, and in- 
sures that the unmapped physical register is no longer 
needed by the data processing system 10. 10 

Since physical registers in register files 37-39 are 
mapped and unmapped each time the SEQUENCER 
20 issues an instruction, system 10 must maintain an 
inventory of those physical registers which were allo- 
cated or deallocated. This inventory system must en- 15 
able the system 10 to recover physical register re- 
sources which are no longer visible, upon the retire- 
ment of an instruction or group of instructions. The re- 
covery of the physical register resources facilitates 
their re-usage by subsequent instructions issued by 20 
the SEQUENCER 20. Using the LR CAMs 40-42, sys- 
tem 10 maintains information pertaining to the map- 
ping, unmapping and visibility of the physical registers 
in the register file 37-39. Each physical register in reg- 
ister file 37-39 has an associated register inventory 25 
system, which includes a random access memory 
(RAM). The RAM stores the visible bits for all CAM 
cells 50 in the LR CAMs 40-42, which are herein re- 
ferred to as "checkpoints". Thus, the register invento- 
ry system maintains a copy of the machine state of 30 
system 10 in a predetermined number of random ac- 
cess memories (RAM). After the SEQUENCER 20 is- 
sues each instruction, a copy of the machine state of 
system 1 0 is made in RAM, and the issue point is ad- 
vanced for the next instruction issuance. 35 

FIG. 4 illustrates the progression of the SE- 
QUENCER 20 during instruction issuance. A consis- 
tent checkpoint (C-POINT) of the system 10 repre- 
sents the machine state checkpoint just after the re- 
tirement of the last instruction, and just before the re- 40 
tirement of the next instruction. The instruction issu- 
ance logic of SEQUENCER 20 progresses by ad- 
vancing the C-POINT of the machine forward as fast 
as possible. The boxes between the points represent 
an instruction or a group of instructions ("packets"). 45 
The retirement checkpoint (R-POINT) represents the 
place where the SEQUENCER 20 can advance. The 
issue checkpoint (l-POINT) point of system 10 is the 
checkpoint just past the last instruction issued. The 
backup checkpoint (B-POINT) represents a check- so 
point just prior to issuance of a set of instructions to 
be discarded due to the occurrence of a branch pre- 
diction mistake or exception condition. Consequently, 
backup may never occur before the current retirement 
point, since by definition retirement only occurs when 55 
an instruction is compl te. Thus, SEQUENCER 20 of 
syst m 10 attempts to advance the issue point as far 
forward from th consistent point as possible, while si- 



multaneously minimizing the amount of backup re- 
quired. 

In accordance with the present invention, set no- 
tation will be us d to xplain th techniqu mploy d 
by syst m 10 to perform and maintain an inventory of 
the register allocation. For simplification purposes, a 
set of values is hereinafter denoted in boldface text 
(i.e. V|) whereas, a distinct value or member of the set 
will be denoted in plain text (i.e. V,). Accordingly, for 
illustrative purposes only, the set of all physical reg- 
isters in register files 37-39 is defined as U (the uni- 
verse). At system reset, the allocated visible registers 
are defined as the set of visible registers at the con- 
sistent state checkpoint V c . Similarly, the set of visible 
registers at: a candidate retirement point is defined as 
V R ; a backup point V B ; and an issue point V|. The set 
of all unallocated physical registers is defined as the 
free (F) set, which comprises all physical registers 
which have not been assigned to a logical register. 
Consequently, the set of all allocated (A) registers is 
defined by the set of all physical registers in register 
files 37-39 (universe U) minus the set of all unallocat- 
ed physical registers (free F), which in set notation 
equals the quantity U-F, where the "-" operator de- 
notes the set difference. 

Accordingly, as the SEQUENCER 20 issues in- 
structions, a logical register is mapped to a physical 
register which becomes both visible and allocated. 
When the logical register is assigned to a new physi- 
cal register, the old physical register becomes invisi- 
ble (unmapped); however, this old physical register 
remains allocated until the instruction which caused 
the register allocation is retired. Essentially, in the 
present invention, a physical register which is visible 
must be allocated; however, a physical register which 
is allocated need not be visible. Thus, at the consis- 
tent point, a backward view in time of all instructions 
previously retired yields the relation V c = Ac, where 
Ac is the set of allocated registers at the consistent 
point. Simply stated, the set of visible registers at the 
consistent checkpoint (at reset) V c equals the set of 
allocated registers at the consistent point Ac. Essen- 
tially, assuming the SEQUENCER 20 had not issued 
any instructions, all visible physical registers are also 
allocated. Invisible registers cannot be made visible 
again, since backup behind the consistent point is not 
allowed. Consequently, any such invisible register 
must also not be allocated. 

As the SEQUENCER 20 issues instructions, the 
set of allocated physical registers grows in size, while 
the set of visible registers remains constant in size. 
This occurrence is attributable to the fact that when a 
physical register is unmapped, system 10 will not 
deallocate that physical register until the instruction 
which unmapped it retir s. Thus, s t notation may 
also be used to defin th physical register allocation 
atth various checkpoints. Accordingly, th set of al- 
located regist rs at th issue checkpoint (A|) is a su- 
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perset of the set of allocated registers at backup (Ab), 
which is a superset of th set of allocated registers at 
the consistent point (Ac). 

Shown in FIG. 5 is a diagram illustrating a retire- 
ment scenario 86 for th syst m 10, in accordance 
with the present invention. In the retirement scenario 
86, system 10 is retiring three checkpoints (CO, C1, 
and C2), and the corresponding three groups of in- 
structions. The act of retirement will deallocate any 
physical register that was allocated by system 1 0 (pri- 
or to the R-point), and that is no longer visible. In the 
present invention, there are two rules which govern 
the consequences of the act of retirement with respect 
to register deallocation. The first rule is based upon 
the assumptions that the physical register 48 is no lon- 
ger a member of the set of visible registers at the re- 
tirement point (V R ), and that the SEQUENCER 20 is 
advancing the system 10 from the consistent point (C- 
point) to a retirement point (R-point). In the first case, 
a physical register 48 in register files 37-39 was map- 
ped to a logical register prior to the C-point. Under the 
first rule, this physical register 48 is a member of sets 
V c (the set of visible registers at the consistent point) 
and Ac (the set of allocated physical registers at the 
consistent point). When system 10 advances from C- 
point to R-point, and physical register 48 is not visible 
at R-point, then the register inventory system ascer- 
tains that physical register 48 was unmapped by some 
instruction issued between C-point and R-point. Es- 
sentially, since V c = Ac, and the set Ac - V R repre- 
sents the physical registers deallocated, the register 
inventory system uses the set relation V c - V R to de- 
fine the physical registers that are deallocated and 
added to the free set F after advancing C-point to R- 
point. 

A second rule is based on the assumption that 
physical registers were allocated between the C-point 
and the candidate R-point, as illustrated in FIG. 5 by 
the quantity AA(1,3). Essentially, the instructions is- 
sued by the SEQUENCER 20 between the C-point 
and the R-point caused the removal of physical reg- 
isters from the free set, and the assignment (alloca- 
tion) by the LR CAMs 40-42 of these physical regis- 
ters as destination registers to be written. Thus, in the 
second case, it is conceivable that a physical register 
48 could be allocated at one issue point and promptly 
deallocated at the next issue point, as a result of two 
successive writes to the same logical register, for ex- 
ample. Since in the second case, the physical register 
48 was not visible at the C-point, and will not be visible 
at the R-point, the first rule does not govern. Conse- 
quently, in the second case, the set relation to define 
the physical registers that are deallocated is AA - V R , 
where AA is the set of physical registers allocated be- 
tween the C-point and th R-point. Ess ntially, AA - 
V R r presents th s t of physical registers allocated 
between the two checkpoints (i.e. A1 ,3) that are no 
longer visible. Th two set relations may be combined 



to form an overall retirement deallocation relation, 
(AA + V c ) - V R , where the operator repr sents set 
union. The d termination of the quantity AA presents 
some subtle difficulti s. Merely recording the set of all 

5 allocated physical r gisters at each checkpoint Ac, 
and then defining AA as A R - Ac is an inadequate 
method for in certain circumstances. 

FIG. 6 illustrates an example of one such case 
when recording the set of all allocated physical regis- 

10 ters at each checkpoint Ac, and then defining AA as 
A R - Ac is an inadequate method for defining the over- 
all retirement deallocation scheme. In FIG. 6, "PX" 
represents a physical register number X; and "RX" 
represents a logical register number X. Initially, the 

15 system 10 is empty. As the SEQUENCER 20 begins 
to issue instructions, the register inventory system 90 
(FIG. 7) begins to make a record of which physical 
registers were visible (V|), and what physical registers 
were allocated (A|) at each issue checkpoint. In the 

20 present example, the SEQUENCER 20 issues a first 
instruction which maps logical register R1 onto phys- 
ical register P0 at checkpoint C1. In FIG. 5 the visible 
and allocated waveforms represent the state changes 
of physical register P0. Thus, at C1, physical register 

25 P0 is a member of A 1t the set of registers allocated at 
C1. As indicated by the visible and allocated wave- 
forms, physical register P0 is now both visible and al- 
located. 

In the next cycle, the SEQUENCER 20 issues an 

30 instruction which unmaps physical register P0 and 
maps logical register number R1 to physical register 
number P2. Now, both physical registers P0 and P2 
are members of A 2 (the set of all registers allocated 
at checkpoint C2), even though P0 is not a member 

35 of V 2 (the set of all registers visible at checkpoint C2). 
In the third cycle, the retirement logic of SEQUENC- 
ER 20 advances the consistent point to checkpoint 
C2. Physical register P0 should be deallocated, since 
it cannot be made visible again. Using the relation of 

40 AA a A R - Ac, and inserting this into the retirement 
deallocation equation, ((AA + V c ) - V R ), the register 
inventory system 90 will correctly deallocate P0. If SE- 
QUENCER 20 issues a branch instruction C3, no al- 
location or unmapping of register will occur. During 

45 the next clock, SEQUENCER 20 issues an instruction 
which causes a write to logical register R4, which 
causes the allocation of P0. Consequently, P0 be- 
comes both visible and allocated. In the following 
clock, another instruction again writes to logical reg- 

50 ister R4, thereby causing physical register P0 to be- 
come invisible, but not deallocated. During 
the V clock period, the retirement logic of SE- 
QUENCER 20 advances the consistent state to C5. 
Since P0 is a member of Aj, and C2 was the old con- 

55 sistent point, any futur differ nc evaluation of AA 
will not includ P0. Thus, if logical register R4 is map- 
ped again to another physical register, and system 10 
retir s to the point wh r R4 was mapp d, th drffer- 
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ence equation AA wilt not deallocate P0. This anom- 
aly will cause physical regist r PO to b com a "lost" 
register, since it will never enter th free pool, and 
thus, will never be availabl for reallocation. 

Th anomaly is caused by th r pres ntation of 5 
allocation as set membership, whereby a physical 
register is a member of a set A or it is not, thus, making 
allocation correspond to a return to zero (RZ) encod- 
ing. In the present invention, allocation corresponds 
to a non-return to zero encoding (NRZ). Essentially, 10 
in the present invention, exclusive set difference is 
used to represent allocation, rather than an inclusive 
set difference. The exclusive difference of "x and y" is 
represented by the function (either x or y, but not 
both); whereas, inclusive difference of "x and y" is rep- 1 5 
resented by the function (either x or y). The advantage 
of using exclusive set difference is that it represents 
allocation as a change in physical register member- 
ship rather than an absolute membership. Thus, the 
difference equation AA = (a c A a r ), where the operator 20 
" A " is exclusive set difference. Furthermore, a change 
in set notation to represent NRZ encoding is used. Ac- 
cordingly, rather than use A to represent the set of al- 
located physical registers, the symbol a is used to rep- 
resent a set of physical register allocation changes; 25 
whereby 0^ represents the register allocation 
changes at the consistent point and ot r , represents 
the register allocation changes at the retirement point. 

The set of physical registers chosen for alloca- 
tion, at reset, may be arbitrary. Referring again to the 30 
retirement scenario 86 of FIG. 5, initially the set cto is 
empty. In between checkpoint CO and C1, physical 
register PO is allocated to logical register R1, and 
therefore, physical register PO becomes a member of 
a v Accordingly, the visibility flag bit of physical regis- 35 
ter PO is set in the visibility latch 76. In between check- 
points C1 and C2, physical register P2 is allocated to 
logical register R1 , causing the visibility flag bit of reg- 
ister PO to be reset. Since physical register PO was not 
re-allocated in between C1 and C2, and C2 and C3, 40 
it is also a member of sets a 2 and <x 3 . In between 
checkpoints C3 and C4, physical register PO is re-al- 
located to represent logical register R4, therefore, 
physical register PO is once again visible. Using the 
exclusive difference equation, we remove physical 45 
register PO from set <x 4 . Notice that in the evaluation 
of AA using NRZ encoding, both (ao A a 2 ) and (a 2 A 
a 6 ) include PO as a member. Consequently, there is 
no lose of the physical register PO as in the case of 
the second example, described above. This is due to so 
the fact at most one transition of alpha, for any phys- 
ical register, may exist between the current consistent 
point and the current issue point. Thus retirement of 
any arbitrary number of checkpoint may be performed 
using th alpha NRZ ncoding of allocation. 55 

The backup and issuance processes also benefit 
from th NRZ encoding of th physical r gister allo- 
cation. In the case of issuance, for every physical r g- 



ister allocated, the register inventory system 90 will in- 
vert the physical registers membership in th next al- 
pha v ctor, with respect to the last issued alpha vec- 
tor. Thus, yielding a d allocation quation for issu- 
anc a, = (a,. , A {allocat d}),wher th quantity "I- 
1" represents the last issued checkpoint and "I" rep- 
resents the checkpoint currently being issued. In the 
case of backup, the above process is reversed. Using 
the selected backup checkpoint, the register invento- 
ry system 90 restores both the alpha value (a) and the 
visibility bit (V,) of the associated physical register to 
the state they had at the time the checkpoint was is- 
sued, and deallocates any physical registers which 
were allocated between the issue checkpoint and the 
backup checkpoint Accordingly, during the backup 
process the NRZ encoding is defined by a dealloca- 
tion equation for backup = (a B A ai), where B and I 
are the backup and last issue point, respectively. 
Since the SEQUENCER 20 will never backup to a 
checkpoint before the current retirement point, the 
two deallocation equations never conflict. Thus, in the 
present invention, backup and retirement may occur 
simultaneously. 

In a preferred implementation of the present in- 
vention, all sets are represented using a bit field. Es- 
sentially, a bit is used to represent membership of a 
physical register, whereby a "0" bit signifies non- 
membership, and a °1° bit signifies membership. Ev- 
ery physical register in register files 37-39 has an as- 
sociated back-up RAM 92, and each back-up RAM 92 
is indexed by checkpoint number. Each back-up RAM 
92 (FIG. 7) stores copies of the alpha (ai) and visible 
(V,) bits, at each checkpoint, for the physical register 
associated with that RAM 92. Accordingly, the back- 
up RAM 92 saves two bits per visible physical register 
48 (ct lf and V|), therefore, in the preferred embodiment 
for "n" physical registers, each alpha and visible vec- 
tor has "n" bits. Thus, if the SEQUENCER 20 allows 
"k" checkpoints, then each RAM 92 is organized as w k M 
by 2 by "n" bits. In addition to RAM 92, there are four 
latches 94, 96, 98 and 100 to save the current values 
of V c , etc, V|,and a,, respectively. 

Each physical register 48 has an associated reg- 
ister inventory system 90 (FIG. 7). The Retire Free- 
able logic 97, Issue Free logic 1 01 , and Back-up Free- 
able logic 1 08 are shown in FIG. 7 on a bit by bit basis. 
Accordingly, the distinct values of the set are denoted 
in plain text (i.e. V ( ). The SEQUENCER 20 issues an 
instruction (checkpoint), by providing the associated 
checkpoint address bits [A1:A3] to the back-up RAM 
92, and providing an ISSUE CONTROL signal to the 
latch 100. In the preferred embodiment, checkpoint 
address bit Ai represents the l-point, checkpoint ad- 
dress bit A 2 represents the R-point, and checkpoint 
addr ss bit A 3 represents th B-point If th issued in- 
struction does not r quir any registers to b written, 
then no new physical registers ar allocat dbytheLR 
CAMs 40-42. When the issu d instruction requir s 



8 



15 EP0 515 

the allocation of physical registers, the ALLOCATE 
signal will caus a physical regist rtobeallocat d.as 
described arli r. Accordingly, th ALLOCATE signal 
is asserted, and th currently latched alpha value cm 
from latch 100 are provided the xclusive XOR-gat 5 
101. The XOR-gate 101 uses the currently latched al- 
pha value oj to form the new value of ai + , for the new- 
ly allocated physical register 48. This new value + f 
is then copied into the back-up RAM 92 and becomes 
the new a,. The invisible bit V| for the newly allocated 10 
physical reg ister 48 is also copied into the RAM 92. Af- 
ter saving copies of the new alpha value a, + , and in- 
visible hit V,, the register inventory system 90 updates 
latch 98 and latch 100 with their new values. Accord- 
ingly, the alpha value and visible bit for each physical 1 5 
register allocated are saved in the back-up RAM 92 at 
the corresponding checkpoint address. Thus, for each 
checkpoint, the register inventory system 90 main- 
tains a snapshot of the allocation of physical registers. 

When the SEQUENCER 20 retires a set of check- 20 
points, the register inventory system 90 uses values 
read from the RAMs 92 to determine which physical 
registers to deallocate. The Retire Freeable logic 97 
determines which physical registers to deallocate 
based upon the current values of the set of allocated 25 
visible registers V c and and the exclusive set differ- 
ence ac A ct R , in addition to the set of invisible registers 
at the retirement point V R . Accordingly, the SE- 
QUENCER 20 asserts the RETIRE CONTROL signal, 
thereby enabling latches 94 and 96 to provide the cur- 30 
rently stored values of V c and a c , respectively to the 
Retire Freeable logic 97, on a per bit basis. The cur- 
rently stored values of V R and ct R are read out of the 
retire port of the back-up RAM 92 and provided to the 
Retire Freeable logic 97. Accordingly, XOR-gate 102 35 
receives the currently stored value of ac from latch 96, 
and a R from the RAM 92 and provides the exclusive 
set difference AA = (etc A a R ) to a first input of OR-ga- 
te 1 04. OR-gate 104 receives the exclusive set differ- 
ence AA, and the currently stored value of V c from 40 
latch 94, and provides an output (AA + V c ) to gate 
106. Gate 106 also receives at a second input termi- 
nal the currently stored value of V R , which is inverted, 
and provides as an output the retirement deallocation 
equation ((AA + V c ) - V^, on a per bit basis. Thus, the 45 
single bit output of gate 106 determines whether the 
associated physical register has become free due to 
retirement of an instruction which unmapped it. Ac- 
cordingly, the collective output bits of gates 106 deter- 
mine which physical registers are deallocated by the so 
LR CAMs 40-42. Upon completion of the retirement, 
latches 94 and 96 are updated with values previously 
read from RAM 92, V R and a R , respectively. 

When SEQUENCER 20 backs up to a specific 
checkpoint, the set of alpha values a 8 read from 55 
RAMs 92 are combin d with th exclusiv set differ- 
ence at issuance ot| to determin which physical reg- 
isters are return d to th fre pool. In th pr ferred 
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embodiment of the present invention, back-up and 
issuance may not occur simultaneously. Cons qu nt- 
ly f when the BACK-UP CONTROL signal is assert d, 
th ISSUE CONTROL SIGNAL may not b asserted. 
By using the sel cted checkpoint, the inv ntory reg- 
ister system 90 restores both the alpha (ctj) and visible 
(V,) bits to the state they had at the time the check- 
point was issued. In doing so, the inventory register 
system 90 deallocates any allocated registers, (a B A 
ct|), and returns the deallocated physical registers to 
the free pool. Accordingly, the SEQUENCER 20 as- 
serts the BACK-UP CONTROL signal, thereby ena- 
bling latch 100 to provide the currently latched value 
of a, to XOR-gate 108. The currently stored value of 
a B is provided to gate 108 by RAM 92. XOR gate 108 
receives the a, and a B values and provides an output 
which represents the exclusive difference between 
the stored alpha value at backup (a B ), and the latched 
alpha value at issuance (a t ). Thus, the single bit out- 
put of gate 108 determines whether the associated 
physical register is returned to the free pool. Accord- 
ingly, the collective output bits of gates 1 06 determine 
which physical registers are returned to the free pool 
by the LR CAMs 40-42. Upon completion of the back- 
up, latches 76 and 100 are updated with values pre- 
viously read from RAM 92, V B and a B , respectively. 

In the present invention, system 90 maintains an 
inventory of the free status of each associated phys- 
ical register using the free reg ister inventory logic 103. 
Essentially, the free register inventory logic 103 
keeps track of activities which return the associated 
physical register to the free pool, such as retirement, 
back-up, and an activity which removes registers from 
the free pool (i.e. allocation). A latch 114 stores the 
status of a "free" (F) bit, which indicates the status, 
free or not free, of an associated physical register. As 
previously indicated, at reset, all invisible physical 
registers are in the free pool, therefore, for all invisible 
physical registers in the register files 37-39, the free 
bit is set at set. OR-gate 1 1 0 has inputs coupled to the 
outputs of the Retire Freeable and Backup Freeable 
logic, 97 and 108, respectively, and an input coupled 
to the free latch 114. Whenever the SEQUENCER 20 
retires a checkpoint, or backs-up to a checkpoint gate 
110 provides the status of the free bit to gate 112. 
Gate 112 also receives, at an inverted input, the AL- 
LOCATE signal, and provides an output signal which 
defines the state of the "free" bit stored in latch 114. 
Collectively, the free register inventory logic 103 of 
system 90 maintains a list of the "free" physical reg- 
isters, the "allocated" physical registers, those physi- 
cal registers which are "freeable" due to retirement or 
backtracking by the SEQUENCER 20, and those 
physical registers which are not longer free due to al- 
location. 

Thus, in the present inv ntion, wh n th SE- 
QUENCER 20 issues an instruction, the associated 
logical (archit ctural) r gister is quickly translated 
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(mapped) to a physical register 48 by the LR CAMs 
40-42, and a new checkpoint number is allocated for 
that instruction. Each physical register 48 in r gister 
files 37-39 has an associated three-port back-up 
RAM 92 which stores register information relevant to 
each checkpoint number. In the preferred embodi- 
ment, the back-up RAM 92 is two bits wide by a pre- 
determined number of checkpoint deep. The back-up 
RAM 92 stores the values of the visible (V) and alpha 
(a) bits, which represent the physical register's state 
changes (i.e. allocated visible, allocated invisible). 
The physical register's state changes are monitored 
by the register inventory system 90 of the LR CAMs 
40-42. when the SEQUENCER 20 needs to back-up 
to a specific checkpoint, the alpha and visible bit val- 
ues are read from the back-up RAM 92 and used by 
the register inventory system 90 to determine which 
registers are returned to the free pool. Similarly, when 
the instruction is complete (DONE), the instruction is 
retired and the register inventory system 90 determi- 
nes those physical registers which are returned to the 
free pool. The Retire Freeable logic 97 and Back-up 
Freeable logic 108 of system allow simultaneous in- 
struction retirement and back-up to occur in a prede- 
fined unit of time. 

While the invention has been described in a pre- 
ferred embodiment, it will be apparent to those skilled 
in the art that the disclosed invention may be modified 
in numerous ways and may assume many embodi- 
ments other than that specifically set out and descri- 
bed above. Accordingly, it is intended by the append- 
ed claims to cover all modifications of the invention 
which fall within the true spirit and scope of the inven- 
tion. 



Claims 

1 . In a data processing system (1 0) having a prede- 
termined number of execution units (25-30) for si- 
multaneously executing a plurality of instructions 
issued by a sequencer (20), and a plurality of 
numbered physical registers in a register file (37) 
for selectively storing information resulting from 
execution by said execution units (25-30) of each 
of said predetermined number of instructions, 
means (90) for performing simultaneous instruc- 
tion retirement and back tracking comprising: 

first means (94,96,97) for monitoring an al- 
location state change of each of said physical reg- 
isters, in response to said sequencer (20) ad- 
vancing from a first consistent checkpoint to a 
subsequent retirement checkpoint; and 

second means (76,1 00,1 01 ,1 08) for simul- 
taneously monitoring said allocation state chang 
of each of said physical registers, in response to 
said sequencer (20) discarding a stream of in- 
structions issu d between a first back-up ch ck- 



point and a subsequent issu checkpoint. 

2. In a data processing syst m (10) having a pr de- 
termined number of ex cution units (25-30) for si- 

5 multaneously x cuting a plurality of instructions 

issued by a sequencer (20), and a plurality of 
numbered physical registers in a register file (37) 
for selectively storing a plurality of data values re- 
sulting from execution by said execution units 

10 (25-30) of each of said predetermined number of 
instructions, means for performing simultaneous 
instruction retirement and backtracking compris- 
ing: 

first means (94,96,97) for monitoring an al- 
15 location state change of each of said physical reg- 
isters, in response to said sequencer (20) ad- 
vancing from a first consistent checkpoint to a 
subsequent retirement checkpoint; 

second means (76,100,101,108) for mon- 
20 itoring said allocation state change of each of said 
physical registers, in response to said sequencer 
(20) discarding a stream of instructions issued 
between a backup checkpoint and a subsequent 
issue checkpoint; and 
25 wherein none of said plurality of data val- 

ues are transferred between said numbered 
physical registers during monitoring performance 
of said first means (94,96,97) or said second 
means (76,100,101,108). 

30 

3. In a data processing system (1 0) having a prede- 
termined number of execution units (25-30) for si- 
multaneously executing a plurality of instructions 
issued by a sequencer (20), and a plurality of 

35 numbered physical registers in a register file (37) 
for selectively storing a plurality of data values re- 
sulting from execution by said execution units 
(25-30) of each of said predetermined number of 
instructions, means (90) for performing simulta- 

40 neous instruction retirement and back tracking 
comprising: 

storage means (76,92,94,96,100) coupled 
to a unique physical register (48) for selectively 
retrieving and storing a first set of bits, in re- 

45 sponse to a first control signal from said sequenc- 
er (20), and for selectively retrieving and storing 
a second set of bits in response to a second con- 
trol signal from said sequencer (20); 

retirement means (97) for coupled to said 

so storage means (76, 92,94,96,100) for monitoring 
an allocation state change of each of said physi- 
cal registers, in response to said sequencer (20) 
advancing from a first consistent checkpoint to a 
subsequent retirement checkpoint, said retire- 

55 ment means (97) retri ving said first set of bits 

and logically combining said first set of bits to de- 
termin whether to deallocate said unique physi- 
cal regist r (48) at a retirem nt checkpoint, and 

10 
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providing a first output deallocation signal repre- 
sentativ thereof; 

backtrack means (101,108) for simultan - 
ously monitoring said allocation state change of 
each of said physical regist rs, in respons to 5 
said sequencer (20) discarding a stream of in- 
structions issued between a first checkpoint and 
a subsequent issue checkpoint, said backtrack 
means (101,108) retrieving said second set of 
bits and logically combining said second set of 10 
bits to determine whether to deallocate said 
unique physical register (48) at a back-up check- 
point, and providing a second output deallocation 
signal representative thereof; and; 

means (103) coupled to said retirement 15 
means (97) and said backtrack means (101,108) 
for logically combining said first output dealloca- 
tion signal and said second output deallocation 
signal to define a set of physical registers which 
are available for reallocation by said sequencer 20 
(20). 
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